Poincare cycle of a multibox Ehrenfest urn model with directed transport 
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We propose a generalized Ehrenfest urn model of many urns arranged periodically along a circle. 
The evolution of the urn model system is governed by a directed stochastic operation. Method for 
solving an TV-ball, Af-urn problem of this model is presented. The evolution of the system is studied 
in detail. We find that the average number of balls in a certain urn oscillates several times before it 
reaches a stationary value. This behavior seems to be a peculiar feature of this directed urn model. 
We also calculate the Poincare cycle, i.e., the average time interval required for the system to return 
to its initial configuration. The result can be easily understood by counting the total number of all 
possible microstates of the system. 
PACS numbers: 05.20.-y, 02.50.Ey, 02.50.-r, 64.60.Cn 
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I. INTRODUCTION 

Physical laws governing the microscopic processes are 
mostly reversible in time. In macroscopic world, however, 
people often experience time-irreversible phenomena in 
their daily life. To understand why the reversible micro- 
scopic processes lead to irreversible macroscopic manifes- 
tations one refers to the Poincare Theorem, which states 
that a system having a finite energy and confined to a fi- 
nite volume will, after a sufficient long time - the so called 
Poincare cycle, return to an arbitrarily small neighbor- 
hood of almost any given initial state [1] . The key point 
is to note that the typical value of a Poincare cycle for 
even a moderate-sized system is far beyond the meaning- 
ful time scale one can measure or experience, thus the 
irreversiblity is realized. 

Usually to describe a macroscopic system one has to 
know only a few parameters, such as volume, pressure, 
and temperature. However, to describe the same system 
in terms of its microscopic constituents, one has to deal 
with a large number of parameters, such as the momenta 
and positions of a huge amount of particles, which are 
impossible to calculate in practice. Based on this reason 
together with the fact that the macroscopic laws are in- 
sensitive to the microscopic details (of system history) , it 
is natural for people to adopt the probability (ensemble) 
description in statistical mechanics, which deals with the 
equilibrium state (a macroscopic state that has station- 
ary value of state parameters) of a macroscopic system. 
In this kind of description the macroscopic quantities are 
defined as the ensemble average of their microscopic cor- 
respondences. This definition connects the microscopic 
and macroscopic worlds. 

To study how a system approaches its equilibrium state 
one also uses probability description, where the evolution 
of the system is treated as a stochastic process. One fa- 



mous model for simulating such a process was proposed 
by Ehrenfest one century ago [2], which is an A^-ball, 
2-urn problem. In the beginning N numbered balls are 
distributed arbitrarily in either urn A or urn B. At each 
time step one ball is picked out at random and then put 
into the other urn. This simple model can be exactly 
solved to give an explicit Poincare cycle. This model 
was then generalized by several authors to mimic more 
complicated situations encountered in real physical phe- 
nomena [3~5] . An attractive feature of these urn model 
problems is that they are easy to formulate but not al- 
ways easy to solve. The solutions obtained have, there- 
fore, sometimes led to new mathematical techniques and 
insights [6-9] . Recently, some new urn models were pro- 
posed and solved analytically or numerically. Their re- 
sults provide very good descriptions on granular and glass 
systems [10-14]. 

In this paper, we obtain the exact solution of a gen- 
eralized urn model. Hereafter we call it "periodic urn 
model". In this model, one considers N distinguishable 
balls which are distributed in M urns. These M urns 
are arranged along a circle and numbered one by one 
to form a cycle, that is, we define the {M -f l)th urn 
as the 1st urn (See Fig. 1). To begin with, the initial 
distribution of the N balls in the M urns is given by 
|"T.i,o, '712,07 ■ ■ ■ I TT^Ai.a) = jrtio): where m^.o is the num- 
ber of balls in the zth urn at the start. At each time 
step one ball is picked out of the N balls such that every 
ball has an equal probability of being picked up. The 
ball is then placed into the next numbered urn. The 
state that the ith urn contains m, balls is represented by 
|mi, 7712, • • • , tum) = |m), which we name it state vector. 
Hereafter we call a distribution string m (without know- 
ing the numbering of the balls) a configuration of the 
system. Otherwise, if we also know the location of each 
numbered ball, we call such a distribution a microstate 
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FIG. 1. Arrangement of the numbered urns and balls in 
our periodic urn model. The gray disks represent the urns, 
and the white disks represent the balls. Here we illustrate a 

configuration for a system with six urns and seven balls. The 
state vector for this configuration is |m) = |2, 1, 0, 2, 1, 1). 

After s steps, the transition probability from state 
|mo) to state |m) can be written as (mlP^jmo), where P 
represents the operation in one step, and the orthonoma- 
hty conditions of these state vectors have been assumed. 

According to the above description, the transition 
probabiUties corresponding to the sth step and the (s — 
l)th step satisfy the recursion relation 

{mi, 1712, ■ ■ • ,mM|f *|mo) 



M 



E ^nr^^" + ^'""'+1 ~ ^' ■ ■ ■ 1^'" Vo), (1) 



N 



where ttim+i = rni as has been mentioned before. In 
addition, any state that docs not satisfy the constraint 



mi + 1712 -\ H "iM = N. 



(2) 



is an unphysical state and has null contribution in the 
sum. Hereafter we will use Eq. (1) as the basis to derive 
all the results we want to know. 

This paper is organized as follows. In the next section 
we calculate the average number of balls in an urn at any 
time. In section III we introduce a generating function 
that has A'^ variables and solve the problem completely. 
In section IV the solution of the model will be applied to 
the calculation of Poincarc cycle. Finally in section V we 
give the summary of this paper. 



A (which depends on the state vector |m) at each step, 
written as A{m.)) after s steps as 



(^), = ^A(m)(m|P«|mo), 

{m} 



(3) 



where {m} include all the configurations satisfying the 
constraint (2). 

Let A{m.) = mi, then from Eq. (1) and (3) we have 

{mi)s = ^ mi (m|P'' I mo), 

{m} 

mi{mj + 1) 



N 



EE 

{m}j=l 

x{---,mj + l,mj+i |P*"^|mo) 

^ I' (m,mj)^_i _ (mj),,_i ^ _^ {mj)s-i 



M 

E 



{mimj)s-i {mi)s-i _^ {mi-i)s 



N 



= ( 1 - ) {mi)s-i + 



N N 

{mi-i)s-i 
N ' 



(4) 



here we have used the constraint (2). 

Now we are ready to solve {mi)s- The recurrence rela- 
tion (4) can be written as 



Ms = PaveMs-l, 

where A^g is a M x 1 column vector defined by 



(5) 



{mi}s 
{m2)s 

{mM)a 



(6) 



and P„,,e is a M X M matrix written as 



p — 

^ ave 



N N 



N 





••• 



(7) 



By means of the recurrence relation (5), Adg can be 
deduced: 



Ms = PLeMo, 



(8) 



II. AVERAGE NUMBER OF BALLS IN AN URN 

The first thing we want to know is how many balls on 
average will appear in the ith urn after first s steps. We 
define the average (the expectation value) of a quantity 



where 



™i,o 



(9) 



2 



represents the initial state. P^^^ can be calculated if one 
knows the eigenvalues and eigenvectors Qm of Pave- 
They are given by (See Fig. 2) 



, (10) 



where 



/ 2m7Ti\ , „ , , 

g„ = exp(-^j, m=l,2,---,M. (11) 



where we have used the following properties of R 

R = R\ {R-') = R^ = {R)* , R^„ = q^ = q^-. (15) 

Now the average number of balls in the ith urn after s 
steps can be determined: 



M M M 



3=1 fc=l 1=1 

M M 

= ]^EE'?^""'^>.o, (16) 
j=i 1=1 

where {mi)o = mifi is the initial number of balls in the 
Zth urn. 



N=50 




FIG. 2. Eigenvalues {Am} of the matrix Pave (represented 
by the tiny circles). Here R = 1 and r = 1/N are the radii 
of two reference circles, and Oa and Ob are their centers, re- 
spectively. The eigenvalues of Pave are distributed uniformly 
on the small reference circle centered at Ob = (1 — 1/iV, 0). 

Denote R as the MxM matrix of the eigenvectors Qm 

R = [Qi,Q2, • • • , Qm] 



qi q2 ■■■ qM 

2 2 2 

qt 92 ■■■ qM 



Qi 92 



1^ 



(12) 



and A as the diagonal matrix of Pave 's eigenvalues A,, 



Ai 
A2 



(13) 



^0 ••• Am 

then we obtain 

P^^^ = RA'R-^ = RA'R^ = RA'R*, (14) 
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FIG. 3. Average number of balls in the first urn (mi)s as 
a function of time s, assuming initially all the balls arc in the 
first urn. licrc wc plot "Fraction" = {mi) s/N for iV = 50 at 
M = 2, 5, 10, 25. As one can sec, except for the M = 2 case 
(which is the original Ehrenfest urn model), this mean value 
oscillates several times before it reaches a stationary value. 

Let us now consider a simple example. Suppose ini- 
tially all the A'' balls are in the first urn, that is. 



then according to Eq. (16), we have 



0, 



{mi)s 



N ^ 



(17) 



(18) 



Fig. 3 shows the resuhs for A^ = 50 at M = 2, 5, 10, 25. 
The M = 2 case is the original Ehrenfest model, in which 
the average number of balls in the first urn decays to 
N/2 in a period of steps of order N. For any M > 2 
case, however, we observe that before the system arrives 
its true equilibrium (here we mean the value of {mi)s 
for each i does not change anymore), (mi)^ undergoes 
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several oscillations, which seems to be a unique feature 
of this model and have never been found in other kinds of 
urn models — to our knowledge. Furthermore, in Fig. 3 
the M = 25 case shows that before the appearance of 
the first peak of (mi)s there is a period during which 
(mi)s is almost zero. This phenomenon together with the 
oscillations mentioned before seem to be typical results 
when both M and N are large. 

M=30 



by 




FIG. 4. Plot of "Fraction" = {mi)s/N as a function of time 
s/N, assuming initially all the balls are in the first urn. Here 
M = 30 and N = 5, 15, 30, 60. Except for the N = 5 case 
(this N is too small), all the curves merge and become one. 
The visible range of "Fraction " has been tuned to give a 
better illustration. 



N=60 




FIG. 5. Plot of "Fraction"= {mi)s/N as a function of time 
s/N, assuming initially all the balls are in the first urn. Here 
N = 60 and M = 30, 60, 90. The first peaks of these three 
curves are located at s/N=30, 60, 90, respectively. 

To understand the behaviors of (mi)^ when N is large, 
note first that in this limit Eq. (18) can be approximated 



N ^ 



s{q-' - 1) 



N 



(19) 



hence {mi) s/N becomes a universal function of s/N 
for a fixed M. In Fig. 4 we plot the {mi)s/N curves 
for M = 30 (which is large enough in practice) and 
N = 5,15,30,60. The N = 5 case is shown here too 
to compare with those cases with large TV. As one can 
see, except for the N = 5 case, the {mi)s/N curves cor- 
responding to different N's merge and become one uni- 
versal function of s/N. In the beginning this function 
decays from 1 exponentially like that in the M = 2 case. 
However, this curve does not decay to its stationary value 
1 /M directly, instead, before it growing up again during 
a period it becomes too tiny to be visible. In practice this 
tiny value can be ignored thus hereafter we treat this pe- 
riod as the "empty-urn" period. The values of {mi)s/N 
in this period for our chosen cases are of the order 10~^. 
The precise duration of the empty-urn period depends 
on how accurate we treat the urn as empty. After this 
period the curve grows up again and oscillates several 
times with evanescent amplitudes and finally approaches 
the stationary mean value l/M. 

Further exploration shows that there can have more 
than one empty-urn period. And the total number of 
these periods, their durations, and the local maxima and 
minima of each {mi) s/N curve are all determined by M . 
Fig. 5 shows the results for iV = 60 at M = 30,60,90. 
These three M's are chosen intentionally to have a simple 
integer proportion 1 : 2 : 3 in order to help us inspect 
relevant results without much effort. The first maxima 
of {mi)s/N for these three M's are located at s/N = 
30,60,90, which are exactly these M's. In addition, the 
locations of the first maxima for M = 60 and 90 are just 
the same locations of the second and third maxima for 
M = 30, respectively. Moreover, for the M = 60 and 
M = 90 cases the total number of empty-urn periods are 
more than one. 

Starting from Eq. (19), we now derive two useful ap- 
proximations of {mi)s/N to help us understand these 
observations. First, define 



s 

N 



(20) 



and expand the exponential functions in Eq. (19) as 
power series of r, we have 



{mi)s 
N 



M 



i=i ^ 



^ M! (2M)! 



+ • 



(21) 



In deriving Eq. (21), we have used the fact that 
Ej^i Qj'" = <li'^ = except for k = rM with 
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r an integer. Note that the form of the jth term (j > 0) 
appearing in the last hne of Eq. (21) is the same as the 
probability of n successful trials in a Poisson process [15]: 



-M/4(2i+l) 



P(n) = 



(22) 



Here n = jM, and t = (n) is the expectation value of 
n. This is not an accident and can be easily understood. 
The quantity {mi)s/N represents not only the average 
number of balls in the first urn divided by N but also 
the probability of finding a certain ball, say, ball 1, in 
the first urn. At each time step ball 1 has the probability 
oi p — l/N being picked out and moved to the next urn. 
Now since N is large, p is small. In this limit if we do 
the same operation s times (here we assume s is also 
large and define t = ps = ,s /N) , then the probability for 
ball 1 to move n steps forward (n successful trials) from 
the first urn is given by Eq. (22). Furthermore, since 
our system has a circulating property, the probability of 
finding ball 1 in the first urn after s steps consists of the 
following possibilities: (1) ball 1 has never been selected 
(the corresponding probability is (1 — p)" ~ e~*"* = e""^), 
and (2) it has been picked up M times, and (3) it has 
been chosen 2M times, and so on. The summation of 
all these contributions gives us the expression of the last 
line of Eq. (21). 

Applying the saddle-point method to each e~'^T^^ term 
and Stirling formula [15] to each (jM)! term, we obtain 



\ e J 



{jM)\ = y/2TrjM 



jM 



jM 



(23) 



(24) 



We thus have 

{mi). 



N 



g-(r-M)2/2M g-(r-2M)2/4M 
e"^ + ; + ; + • 



\/27rM 



\/4irM 



(25) 



Eq. (25) tells us that: (1) The {mi)s/N curve consists 

of an exponentially decaying term e~'^ and a scries of 
Gaussian terms of different heights. (2) The center of 
the jth Gaussian term is located at jM, which is also a 
good approximation to the location of the jth local max- 
imum of the {mi)s/N curve. The separation between 
two successive maxima is thus At = M. (3) The height 
and the standard deviation of the jth Gaussian term are 
1/^/2ttJM and ^/jM, respectively. (4) If j << M we 
have \fjM << At, and the overlap between two succes- 
sive Gaussian terms can be neglected. In this situation 
the {m\)s/N curve in the neighborhood of jM can be 
well approximated by the jth Gaussion term. Similarly, 
the jth local minimum between the jth and (j -|- l)th 
local maxima are approximated by 



v7 y(jTi)y 



(26) 



When j is too large, Eq. (25) becomes inaccurate, and 
we must find another expression for better descriptions. 
Note that Eq. (19) can be rewritten as 



N 



1 

M 



l + 2e-^(i-'^°"^^)cos(Tsin6ii) 



+ 2e-^(i-^°^^=) cos(Tsin6l2) + • • • 



where we have defined 

27r7 2-77 
^ M •' M 

Remember that M is a large number, so 



sin^i K 0, 1 — cos^i « — . 
We thus have the approximation 

(mi)s 1 + 2e-^^'/2 cos {tO) + 2e-2^^' cos (2t6I) 



N 



M 



(27) 



(28) 



(29) 



(30) 



for describing the behaviors of {mi)s/N curve in the re- 
gion T >> M2/27r2, that is, t(1 - cos6'i) « » 1. 
Prom this expression we also get the result 



lim(mi)s = ^, 



(31) 



which must be true after the system has reached its sta- 
tionary state. 



(a) M=2 



(b) M=5 



(c) M=15 



(d) M=60 





FIG. 6. Plot of the trace of the center of mass (COM) 
as a function of time step s, assuming initially all the balls 
are in the first urn. Here the curves are plotted for s = 
to s = 2MN with M = 2, 5, 15, 60. Each curve with large 
enough M {M > 10) has circulated the origin (the "x" sym- 
bol) of the complex plane twice after evolving 2MN steps. 
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Up to now wc have been focusing our attention on 
only one single urn. In fact, we can also understand the 
behaviors of the system in a global manner. First, let's 
define the "phase angle" of the fcth urn (see Fig. 1) as 



-(A; - 1)61. 



(32) 



Now we define the "center-of-mass" (COM) of the AT-ball, 
M-urn system as 



M 



COM=^e^^''(mfc),. 



(33) 



fe=i 



(a) M=2 



(b) M=5 



(c) M=15 



(d) M=60 





FIG. 7.' These COM curves are plotted for s = to 
s = M^N/tt'^ with M = 2, 5, 15, 60. The norm of a COM 
in the complex plane becomes = 0.1353 times smaller af- 
ter evolving M'^N/tt^ steps if M is large enough (M > 10). 
Here the symbol "x" denotes the origin. 

According to Eq. (33) the COM is in general a complex 
number, say, Z = Re^'^ . Here R = \Z\ satisfies < i? < 
A'', and cj) is the phase angle of Z. The variation of the 
the phase angle (p with respect to s or t = s /N represents 
how fast on average these N balls circulate around the 
M urns, and the norm R here gives us the information 
of the extent of the distribution of the N balls. If we 
consider the normalized center-of-mass COM/A = re*"^ 
instead of COM, we conclude that the trace of re"* must 
be contained inside the imit circle. Substitute (18) and 
(32) into (33) and use (10) and (11), we get 



M M 
3=1 k=l 



N M 



hence 



r = e 



-t6. 



(34) 
(35) 



Here we see that the COM/A curve is approximately de- 
scribed by a spiral circulating inside a unit circle. The 
angular frequency of the circulating motion of the COM 
with respect to s \s —9 = — 27r/M (clockwise), consis- 
tent with both the definition of our game and the os- 
cillation behaviors of the COM/A curve discussed be- 
fore. Furthermore, when r > M^/27r^ we have r < e~^, 
which indicates that the system has a wide extent of the 
ball-distribution, also consistent with the previous dis- 
cussions. Some examples are illustrated in Fig 6 and 
Fig. 7. 



III. STATE MATRIX AND GENERATING 
FUNCTION 

Now we calculate (mlP^lmo) - the transition proba- 
bility from |mo) to |m) after s steps. Once one knows 
the exact solution of (mlP'^lmo), any quantity can be 
calculated explicitly. 

Define 



"Smm' = (m|P|m'), 



then we have: 



Here 5 is a x matrix, we name it state matrix, 



(m|P«|mo) = {S'U^,. 

'jjf X matrix, we na: 
and |m) is a column vector, here 

rrM _ rN+M-1 _ (A + M-1)! 



(36) 
(37) 



(38) 



Like before, can be calculated by means of its eigen- 
values and eigenstates. According to Eq. (1), the matrix 
S has components 



M 



Errii + l . 



1^1 



where rriM+i = have been assumed. The eigenvalue 
equation can be written as 



{m'} 



= 7^m, 



(40) 



or more explicitly 

M , . 



A 



^*mi,m2,-")'"T'i + l)^i + l~l)'")^M 



— 'T0mi,m2,-")'^i)"^i+i)'")^ 



(41) 

= 



In the above expression we have set 4>mi.m2.---.mM 
for those |m) = |toi, m2, • • • , ttim) that do not satisfy 
the constraint (2). 



6 



It is not an easy task to diagonalize S directly. Thus 
we adopt another strategy. We first construct a gener- 



M 



ating function for (pmi. 



m2,---,mM 



and then transform the 



matrix eigenvalue equation (40) to its differential equa- 
tion form. We find that the differential equation can be 
solved analytically. 

By introducing variables Xi,X2, - " ^ Xm, the generating 
function can be defined as 



f{xi,X2, ■■■ , Xm) = ^ (t>mi. 

{m} 



»n2,---,mM2'i ^2 



Hereafter we also use the following expression 

/(X) = <^mX'", 
{m} 

where X and are defined by 



Xl 
X2 



(42) 



(43) 



Xm 



(44) 



To proceed further, note that /(X) satisfies the follow- 
ing two relations: 

a,J(X) = ^ (mi + !)</) 

{m} 

Xxf{y^) = ^ (?i'mi,r„2,...,m,_i,...,m„X™, (45) 



{m} 



as can be easily checked. Multiplying X™ on both sides 
of Eq.(41), summing over all {m}, and using the results 

of (45) , we get 



M 



i=l 

or equivalently 

M 



^a;,+ia,,ln[/(X)]=iV7, 



(46) 



(47) 



which is the desired differential equation form of the 
eigenvalue equation (41). Define 



we find 



Xq, = XiQj + X2qj H 1- XMqf, 



M 

'^Xi+id:^. ln(xgj = qj^ = 



(48) 



(49) 



This implies that the complete solution of ln[/(X)] can 
be written as 



ln[/„(X)]=^n,ln(x,p, 



(50) 



which gives us 



M 



/„(x)=n^^^^q- 

i=i 



(51) 



Here /n(X)(a homogeneous A^th power function) and the 
eigenvalue 7„ are characterized by n = [rii, n2, • • • , um] 
and q = [gi, ^2, • • • , 9m], satisfying 



M 



M 



n • q 



(52) 



Denoting the n-th eigenvector of S as ^(n), Eq. (40) 
and (43) now become 



and 



5'mm'0in'(n) = 7n0in(n) 

{m'} 



{m} 



(53) 



(54) 



To diagonalize S we first define an orthogonal trans- 
formation matrix U : 



Umn = ^in(n), 



(55) 



where (/)m(n) according to Eq. (54) is the coefficient of 
X™ that appears in the expansion of /n(X) = X^. 

We now are ready to solve the matrix U~^. Multiply- 
ing = a;™ia;™= • • • a;^" on both sides of 



{n} {n} 

and summing over all possible {m}, we get 

{n} {n} 

Furthermore, define two vectors Y and Xq as 



(56) 



(57) 



yi 













and 



91 


92 ••• 






9i ••• 


9m 






M 




# ••• 






Xqi 




= 


Xq2 






_ XqM 







Xl 




X2 







(58) 



(59) 
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we have 



Y = \/MiiX. 



(60) 



Using the same notation and remember that R ^ = 
R*, we find 



Vm m " 

These results further lead to 

ml m 1 m 1 



(61) 



{n} 



{n} 



Z]•^"(^)^"(™)• 



{n} 



Comparing Eq. (62) with (57), we get: 



1 



nm 

where we have used the relations: 



(m), 



(62) 



(63) 



^95 ^93 

..mi ma 

VqM-iyqM-2^qM 

..mM-l„,mM-2„.r 
Vqi yq2 fga 

= = /a(y), 



9m- 



,,m2 „,m3 . . . ,,™M-l,,mM 

yqM-it>qM-2yqM-3 Hqi ^qm ' 

,,niM-l,,niM-2,,mM-3 . . . -."iM 
i/qi .yq2 fgs UqM-iyqM ' 



and defined ih as 

m = [mM-i,mM-2,?TiM-3, • • • ,mi,mM] 



(64) 



(65) 



Finally we obtain the desired solution of (m|P*|mo): 
(m|P«|mo) = (5«)mmo, 

= i\^E'^m"^'"(™')'^'"'(™o)' (66) 

m' 

where F is the eigenvalue matrix of S, which has compo- 
nents Fmm' = 7m<5mm' • 



IV. POINCARE CYCLE 

In this section, we study the Poincare cycle of our pe- 
riodic urn model. For simplicity we first consider the 
situation that initially all the N balls are stayed in the 
last urn, i.e., 



mo = [0,0,0, •••,7V]. 
Prom (67) and (65) we have 

mo = riiQ. 



(67) 



(68) 



Now we want to know how many time steps on average 
are required for all of the TV balls to return to the last 
urn (the initial state). We thus have to calculate 

(molP^mo) = ^^7m<^mo(m)</.m(mo). (69) 

m 

Recall that <?f)m(n) is nothing but the coefficient of 

appearing in the expansion of 
■■x^i^. From Eq. (54) and (67), 



/„(X) = 
we have 



(rho) 



^mo(m) = 1, 



N\ 

1 \m.n\m.o\ ■ ■ ■ m.n.r\ 



N 
m 



(70) 



(71) 



mi'.m2'-m3'. ■ ■ ■ tum- 
and hence 

(molPlmo) = ^Y.{1)^'^^ ns). (72) 



Here P(s) represents the transition probability for the 
system to return to the initial state after s steps. It 
does not preclude the possibility that the initial state 
has already been re-arrived before. 

Since Poincare cycle is defined as the time interval re- 
quired for the event of first return to happen, so we have 
to do more calculations to extract what we really want. 
We define a function Q{s) as the probability for the event 
of first return to happen at the sth step. The Poincare 
cycle can thus be defined as 



P.C. = 5]sQ(s). (73) 
By definition Q(s) relates to V{s) via the relation 

s-l 

V{s) = Q{s) + Y,Q{k)T{s-k), (74) 



fc=i 



and hence Q{s) can be calculated from V{s). To ease 
the calculation we now use again the generating function 
method. We first define two generating functions: 

oo oo 

/l(z)^^P(s)^^ 5(^)^^Q(s)^^ (75) 

s=l s=l 

and then we find from Eq. (74) that 

h{z) 

These two generating functions also lead to 

h' 



(76) 
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which can determine the Poincare cycle. 

We now calculate h{z). From Eq. (72) and (85) we 
obtain 



oo 



N 

m I ^ 



(7mZ)' 



1 - 7m2 



(78) 



Since we know from Eq. (52) that 7ino 
z 1~ , h{z) becomes singular: 



In this limit, we obtain 



lim 



+ regular function. (79) 



h' 



lim q' — ^^^^ , 

^^1-^ z^l-(l + /l)2 



M 



N 



which gives us the desired Poincare cycle: 

oo 

P.C. = ^sQ(s) =M^. 



(80) 



(81) 



s=0 



To understand this result, we refer to the ergodic the- 
orem [1], which says that if one waits a sufHciently long 
time, the locus of the representative point of a system 
will cover the entire accessible phase space. For our pe- 
riodic urn model, the "representative point" corresponds 
to the microstate of the arrangement of balls, the "acces- 
sible phase space" is the set of total microstates, and the 
"locus" means the evolution history of the system (See 
Fig. 1). Since in our periodic model every microstate 
has the same probability to appear (a fundamental as- 
sumption of statistical mechanics), and the set of total 
microstates contains microstates, therefore on aver- 
age one has to wait time steps to see a microstate 
reappearing again. 

What will be the Poincare cycle if the initial state is 
different from the mo in Eq. (67)? Let's denote the initial 
state by d: 



|d) = \di,d2,...,dM)- 



Now we have 



V{S) = {d\nd) = ^Y,YM^)<Pm{d), 



{m} 



and 



h{z) 



{m} 



i!'d(m)(/)m(d) 



1 - XmZ 



(82) 



(83) 



(84) 



In general it is difScult to calculate </'d(m) and (/>m(d)- 
However, we do not need to calculate them all. Remem- 
ber that to determine the Poincare cycle the the knowl- 
edge of the asymptotic form of h{z) near z = 1 is enough. 
This is given by 



, . ^ <?^d(mo)?;imo(d) z 1 r .• 

hm h{z) = — — ' — h regular function. 

z— >1~ 1 — z 

(85) 



Substituting 



!!>d(mo) = ( ^ 



,(d) = l 



1, thus when into (85), we find 



P.C. = lim 



M 



N 



z^l- {l + hf 



(86) 



(87) 



This result conforms with our intuition. Consider the 
difference between the concepts of configuration and mi- 
crostate , one can easily understand this result because 
the degeneracy of the configuration d is given by 



di\d2\ ■ • • dM^- 



V. SUMMARY 

In this work we propose a generalized Ehrenfest urn 
model of many urns arranged periodically along a circle. 
We solve an A^-ball, M-urn problem explicitly. The evo- 
lution of the system is studied, and the average number 
of balls in a certain urn at any time step is calculated. 
We find that this mean value oscillates several times be- 
fore it arrives the stationary value. We also obtained the 
Poincare cycle. The result is consistent with the consid- 
eration of the total number of possible microstates of the 
system. 
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